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RESEARCH ANNOUNCEMENT 



INTEGRATION AND APPROXIMATION 

OF MULTIVARIATE FUNCTIONS: 
AVERAGE CASE COMPLEXITY WITH 
ISOTROPIC WIENER MEASURE 

G. W. WASILKOWSKI 



Abstract. We study the average case complexity of multivariate integration 
and L2 function approximation for the class F = C([0, l] d ) of continuous 
functions of d variables. The class F is endowed with the isotropic Wiener 
measure (Brownian motion in Levy's sense). Furthermore, for both problems, 
only function values are used as data. 



1. Introduction 

We study the integration and function approximation problems for multivariate 
functions /. For the integration problem, we want to approximate the integral of / 
to within a specified error e; and for the function approximation problem, we want 
to recover / with the Li error not exceeding e. To solve both problems, we would 
like to use as small a number of function values as possible. 

Both problems have been extensively studied in the literature (see, [9, 16] for 
hundreds of references). However, they are mainly addressed in the worst-case 
setting. In the worst-case setting the cost and the error of an algorithm are defined 
by the worst performance with respect to the given class F of functions /. Not 
surprisingly, for a number of classes F, the integration and function approximation 
problems are intractable (prohibitively expensive) or even unsolvable. For instance, 
if F consists of continuous functions that are bounded by 1, no algorithm that uses a 
finite number of function values can approximate the integral of /, nor can it recover 
/ with the worst-case error less than 1. Hence, both problems are unsolvable for 
e < 1. Assuming that functions / have bounded rth derivative in the sup-norm, 
the number of function values required for the worst-case error not to exceed e is 
of order e~ d l r . Hence, for fixed r, it is exponential in d. 
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Due to intractability in the worst-case setting, the average-case setting is of inter- 
est. In the average-case setting, the class F is equipped with a probability measure 
/i. The error and the cost of an algorithm are measured by the expectations with 
respect to /i. Then, the average-case complexity (with respect to /i) is defined as 
the minimal expected cost needed to compute an approximation with the expected 
error not greater than e. 

The majority of the average-case results obtained so far (see, [3-6, 9-18, 21]) deal 
with scalar functions (d = 1). These results indicate that for a "reasonable" choice 
of measure fi, the integration and function approximation problems are significantly 
easier on the average than in the worst-case setting. Thus, one could hope that 
the intractability (or even noncomputability) of multivariate problems in the worst- 
case setting can be removed by switching from the worst-case to the average-case 
setting. 

This hope has recently been supported by Wozniakowski (see [23, 24]), who an- 
alyzes integration and function approximation for the class F = C([0, l] d ) endowed 
with the Wiener sheet measure /z. He proves that the average-case complexities of 
both problems are only weakly dependent on the number of variables. Indeed, the 
average-case complexity of computing an e-approximation is Q(e~ 1 (loge~ 1 Y d ~ 1 ^ 2 ) 
for the integration problem and 9(£ _2 (loge _1 ) 2 ( d_1 )) for the function approxima- 
tion problem. 

In this paper we study the average-case complexity of the integration and func- 
tion approximation problems. However, instead of the Wiener sheet measure, we 
endow the class F — C([0, l] d ) with the isotropic Wiener measure (or Brown- 
ian motion in Levy's sense). We prove that the average-case complexity equals 
@( e -2/(i+i/d)^ f or integration problem and 0(e~ 2d ) for the function approxi- 
mation problem. Unlike the Wiener sheet measure, the average-case complexity of 
the function approximation problem depends strongly on d. In particular, for large 
d this problem is intractable since its complexity Q(e~ 2d ) is exponential in d and 
is huge even for a modest error demand e. For large d the average-case complexity 
of the integration problem is essentially proportional to e~ 2 , which is the highest 
possible average-case complexity of the integration problem. Indeed, for any prob- 
ability measure with finite expected value of ||/||| 2 , the average-case complexity is 
bounded from above by 0(e~ 2 ). Hence, this is again a negative result. 

Thus, the average-case complexities of integration and function approximation 
problems are very different depending on whether /j, is the Wiener sheet or isotropic 
Wiener measure. It is interesting to note that both measures are identical when 
d = 1. They are different for d > 1; results of [23, 24] and our results indicate how 
drastically different they are. 

The paper is organized as follows. Section 2 provides basic definitions. The main 
results are presented in §3. In addition to results already mentioned, §3 discusses 
optimality of Haber's [2] modified Monte Carlo quadrature and of a piecewise con- 
stant function approximation. It also contains a result relating the average-case 
complexities of the integration and function approximation problems for general 
probability measures. In this paper we omit all proofs because of their substantial 
length. 



2. Basic definitions 
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In this paper we consider the following integration and function approximation 
problems for multivariate functions. Let F = C(D) be the space of functions 
/ : D — ► M where D is a bounded subset of R d . For simplicity, we take D = [0, l] d 
as a unit cube. For every / € F we wish to approximate S(f), where S : F — > G 
with 

S(f ) = Int(/) = / f(x) dx and G = K for the integration problem, 
Jd 

S(f) = App(/) = / and G — Li(F)) for the approximation problem. 

We assume that the functions / are unknown; instead we can compute informa- 
tion N(f) that consists of a finite number of values of / taken at some points from 
D. For a precise definition of N see [16]. Here we stress only that 

N(f) = [f( Xl ),...,f(x n )}, 

where the points X{ and the number n of them (called the cardinality of N) can 
be selected adaptively and/or randomly. That is, for adaptive N, Xi's depend 
on previously computed values f(xi), . . . , /(a^i), and the cardinality n = n(f) 
varies with / based on computed values. For randomized N, the points Xi and the 
cardinality n(f) may also depend on an outcome of a random process t. (That is, xi 
is selected randomly with an arbitrary distribution that may depend on previously 
computed values of /; the distribution oin( f) may also depend on observed values.) 
In such a case, we sometimes write N(f) — N t (f). 

An approximation U(f) to S(f) is computed based on N(f). That is, 

U(f) = cf>(N(f)), where <j> : N(F) -» G 

is an arbitrary mapping; (f> is called an algorithm that uses N. The algorithm <p can 
also be random; in such a case, we sometimes write <f> = 4>t- 

In the average-case setting, we assume that the space F is endowed with a 
(Borel) probability measure /i. Then the average error and the average cost 1 of tfi 
are defined respectively by 

e«*toJ\r,£,M) :=^E t (\\S(f)~MNtU))\\ 2 G ), 
cosi avg (0,iV,S,,i) :=E M E t (n(/)). 

(By E M and Et we denote the expectations w.r.t. [i and t, respectively.) Of course, 
for deterministic N and <p, 

e^(<f>, N, S, fx) =^JjjS(f)-<i>(N(f))\\%»(df), 

C0S t^(ct>,N,S,fx)= f n{J)^{df). 

Jf 



1 We measure the cost by the expected number of function values neglecting the combinatory 
cost of N and of <j>. With the exception of Theorem ^, this is without loss of generality since, as 
explained in a number of references (see, e.g., [16]), for Gaussian measures the same results hold 
for a more general definition of the average cost, provided that a single arithmetic operation is no 
more expensive than a function evaluation. 
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The average-case complexity is the minimal average cost for solving the problem 
to within a preassigned error accuracy e. That is, 

comp avg (e, S, fi) := inf {cost avg (0, N, S, fi) : e avg (<?i>, N, S, //) < e} . 

(We stress that the infimum above is taken with respect to all randomized <j> and 
N.) 

In this paper we analyze the average-case complexity of the integration and 
function approximation problems (S = Int and S = App) with the assumption that 
the probability fi is the isotropic Wiener measure. This measure is also referred to as 
the Brownian motion in Levy's sense. For more detailed discussion and properties 
of fi (sec [1, 7, 8]). Here we only recall that fi is a zero-mean Gaussian measure 
with the correlation function 

K{Xty)= W^LM V x,yeR d , INI 2 = XX 



3. Main results 

Theorem 1. For the integration and function approximation problems, 

(1) comp avg (e, Int, M ) =6 ( e -2/(i+i/<*)) ; 

(2) comp avg (e, App, M ) =6 (e- 2d ) . 

For d = 1, fj, equals the classical Wiener measure. Hence, for scalar functions 
this theorem follows from known results (see [12, 13, 19]). 

We now exhibit algorithms and information that are almost optimal. Let n = 
p d . Partition D into n equal-sized cubes Ui — Xi + [— l/(2p), +l/(2p)] d , each 
centered at a;,. For the integration problem, consider the following randomized 
information and algorithm due to Haber (see [2]): 

n 

(3) AT (/) = [f( tl ), f(t n )} and cf>™(N™ (/)) = - ^ /fe), 

J = l 

where tj's are uniformly distributed in C/j's. For the function approximation prob- 
lem, consider 

n 

(4) A a pp(/) = [/(*!),...,/(*„)] and cf,^(N^(f)) = ^9i(-)f(xi), 

i=l 

with <7i being the indicator function for the set [/j. 

Theorem 2. For every n, the average errors o/^ 11 * and (f>n PP are respectively equal 
to 

^J D lD\\ x -y\\/ 2dxd y ^J D M/2dx 



n l/2+l/(2d) " " n l/(2d) 
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These algorithms are almost optimal. Indeed, for n Int (e) and n App (e) given by 



n Int (e) 



e- 2 



J D Jjx-y\\/2dxdy^j 



l/fd+i)" 1 d 



n App (e) 



£- A / ||ar||/2das 



^n"**^) an ^ ^n^(s) ^ ave the average errors less than or equal to e and their costs 
are proportional to (1) and (2), respectively. 

Remark 1. In the worst-case setting with F = C[0, l] d , Habcr's modified Monte 
Carlo algorithm <^ nt and the classical Monte Carlo algorithm n" 1 Ym=i /(*») (with 
tiS uniformly distributed in D) have (modulo constants) the same errors that are 
proportional to 1/^/n. It can be proven that the average error of the classical 



Monte Carlo algorithm equals yn 1 J D J D \\x — y\\/2 dxdy. Thus, it is precisely 
n 1 ^ 2 ^ times larger than the average error of (fi^ 1 - 

Remark 2. Although the information A^ nt is randomized, the cardinality n is fixed. 
Thus, the mean value theorem implies the existence of deterministic N*(f) = 
[/(#*)>•••>/«)] such that 4>* n (N*(f)) = n ^ 1 Tn=if( x t) has the average error 
not exceeding the average error of <^ nt . (We do not know the location of the points 
x*; we only know that x* € Ui, 1 < i < n.) This and the fact that the algorithm 
and information given in (4) are deterministic imply that randomization does not 
help for both problems. The lack of power of randomization holds for more general 
problems. Indeed, randomization does not help for linear S and Gaussian \x (see 
[20, 22]). 

The final theorem relates the average-case complexities of the integration and 
function approximation problems for an arbitrary (Borel) probability measure. 

Theorem 3. Let v be an arbitrary probability measure on F. If 

comp avg (e,Int,z/) = fi(e- p ) 

for some p (obviously, p < 2 whenever ||/|||, 2 ( D ) has a finite (v-) expectation), then 

comp avg (e,App,i/) = fl (Vp^A 2 ^))) . 

Remark 3. This theorem can easily be extended in a number of ways. For instance, 
it holds when the function approximation problem is considered with the L2(D)- 
norm replaced by ||/ — /*|| 2 = J D w(x)(f(x) — f*(x)) 2 dx, aweighted norm, for some 
weight w > and the integration problem defined by Int(/) = J D f(x)y / w(x) dx. 

It also holds in the worst-case setting with randomization. In this setting, instead 
of the expectation E„, we take the supremum w.r.t. / e Fq (Fq is a given subset 
of F) in the definitions of the error and cost (the expectation w.r.t. random t 
remains). (For more detailed definitions, see [16]). Hence, again, in the worst-case 
setting with randomization, integration is an easier problem than is the function 
approximation problem. We stress that this need not be true if the worst-case 
deterministic (without randomization) setting is considered, since for a number of 
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classes Fo the integration and approximation problems have asymptotically the 
same worst-case deterministic complexities (see, [9, 16]). 
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